Unmet expectations about material properties delay perceptual decisions.

Based on our expectations about material properties, we can implicitly predict an object's future states, e.g., a wine glass falling down will break when it hits the ground. How these expectations affect relatively low-level perceptual decisions, however, has not been systematically studied previously. To seek an answer to this question, we conducted a behavioral experiment using animations of various familiar objects (e.g., key, wine glass, etc.) freely falling and hitting the ground. During a training session, participants first built expectations about the dynamic properties of those objects. Half of the participants (N = 28) built expectations consistent with their daily lives (e.g., a key bounces rigidly), whereas the other half learned an atypical behavior (e.g., a key wobbles). This was followed by experimental sessions, in which expectations were unmet in 20% of the trials. In both training and experimental sessions, the participant's task was to report whether the objects broke or not upon hitting the ground. Critically, a specific object always remained intact or broke - only the manner in which it did so differed. For example, a key could wobble or remain rigid but never break. We found that participants' reaction times were longer when expectations were unmet, not only for typical material behavior but also when those expectations were atypical and learned during the training session. Furthermore, we found an interplay between long-term and newly learned expectations. Overall, our results show that expectations about material properties can impact relatively low-level perceptual decision-making processes.

Tilt aftereffect spreads across the visual field.

The tilt aftereffect (TAE) is observed when adaptation to a tilted contour alters the perceived tilt of a subsequently presented contour. Thus far, TAE has been treated as a local aftereffect observed only at the location of the adapter. Whether and how TAE spreads to other locations in the visual field has not been systematically studied. Here, we sought an answer to this question by measuring TAE magnitudes at locations including but not limited to the adapter location. The adapter was a tilted grating presented at the same peripheral location throughout an experimental session. In a single trial, participants indicated the perceived tilt of a test grating presented after the adapter at one of fifteen locations in the same visual hemifield as the adapter. We found non-zero TAE magnitudes in all locations tested, showing that the effect spreads across the tested visual hemifield. Next, to establish a link between neuronal activity and behavioral results and to predict the possible neuronal origins of the spread, we built a computational model based on known characteristics of the visual cortex. The simulation results showed that the model could successfully capture the pattern of the behavioral results. Furthermore, the pattern of the optimized receptive field sizes suggests that mid-level visual areas, such as V4, could be critically involved in TAE and its spread across the visual field.

Increasing the spatial extent of attention strengthens surround suppression.

Here we investigate how the extent of spatial attention affects center-surround interaction in visual motion processing. To do so, we measured motion direction discrimination thresholds in humans using drifting gratings and two attention conditions. Participants were instructed to limit their attention to the central part of the stimulus under the narrow attention condition, and to both central and surround parts under the wide attention condition. We found stronger surround suppression under the wide attention condition. The magnitude of the attention effect increased with the size of the surround when the stimulus had low contrast, but did not change when it had high contrast. Results also showed that attention had a weaker effect when the center and surround gratings drifted in opposite directions. Next, to establish a link between the behavioral results and the neuronal response characteristics, we performed computer simulations using the divisive normalization model. Our simulations showed that using smaller versus larger multiplicative attentional gain and parameters derived from the medial temporal (MT) area of the cortex, the model can successfully predict the observed behavioral results. These findings reveal the critical role of spatial attention on surround suppression and establish a link between neuronal activity and behavior. Further, these results also suggest that the reduced surround suppression found in certain clinical disorders (e.g., schizophrenia and autism spectrum disorder) may be caused by abnormal attention mechanisms.

Cortical connectivity in the face of congenital structural changes-A case of homozygous LAMC3 mutation.

The homozygous LAMC3 gene mutation is associated with severe bilateral smoothening and thickening of the lateral occipital cortex . Despite this and further significant changes in gray matter structure, a patient harboring this mutation exhibited a range of remarkably intact perceptual abilities . One possible explanation of this perceptual sparing could be that the white matter structural integrity and functional connectivity in relevant pathways remained intact. To test this idea, we used diffusion tensor and functional magnetic resonance imaging to investigate functional connectivity in resting-state networks in major structural pathways involved in object perception and visual attention and corresponding microstructural integrity in a patient with homozygous LAMC3 mutation and sex, age, education, and socioeconomically matched healthy control group. White matter microstructural integrity results indicated widespread disruptions in both intra- and interhemispheric structural connections except inferior longitudinal fasciculus. With a few exceptions, the functional connectivity between the patient's adjacent gray matter regions of major white matter tracts of interest was conserved. In addition, functional localizers for face, object, and place areas showed similar results with a representative control, providing an explanation for the patient's intact face, place, and object recognition abilities. To generalize this finding, we also compared functional connectivity between early visual areas and face, place, and object category-selective areas, and we found that the functional connectivity of the patient was not different from the control group. Overall, our results provided complementary information about the effects of LAMC3 gene mutation on the human brain including intact temporo-occipital structural and functional connectivity that are compatible with preserved perceptual abilities.

Dynamic dot displays reveal material motion network in the human brain.

There is growing research interest in the neural mechanisms underlying the recognition of material categories and properties. This research field, however, is relatively more recent and limited compared to investigations of the neural mechanisms underlying object and scene category recognition. Motion is particularly important for the perception of non-rigid materials, but the neural basis of non-rigid material motion remains unexplored. Using fMRI, we investigated which brain regions respond preferentially to material motion versus other types of motion. We introduce a new database of stimuli - dynamic dot materials - that are animations of moving dots that induce vivid percepts of various materials in motion, e.g. flapping cloth, liquid waves, wobbling jelly. Control stimuli were scrambled versions of these same animations and rigid three-dimensional rotating dots. Results showed that isolating material motion properties with dynamic dots (in contrast with other kinds of motion) activates a network of cortical regions in both ventral and dorsal visual pathways, including areas normally associated with the processing of surface properties and shape, and extending to somatosensory and premotor cortices. We suggest that such a widespread preference for material motion is due to strong associations between stimulus properties. For example viewing dots moving in a specific pattern not only elicits percepts of material motion; one perceives a flexible, non-rigid shape, identifies the object as a cloth flapping in the wind, infers the object's weight under gravity, and anticipates how it would feel to reach out and touch the material. These results are a first important step in mapping out the cortical architecture and dynamics in material-related motion processing.

Unmet expectations delay sensory processes.

Expectations strongly affect and shape our perceptual decision-making processes. Specifically, valid expectations speed up perceptual decisions, and determine what we see in a noisy stimulus. Despite the well-established effects of expectations on decision-making, whether and how they affect low-level sensory processes remain elusive. To address this problem, we investigated the effect of expectation on temporal thresholds in an individuation task (detection of the position of an intact image, a house or face). We found that compared to a neutral baseline, thresholds increase when the intact images are of the unexpected category, but remain unchanged when they are of the expected category. Using a recursive Bayesian model with dynamic priors we show that delay in sensory processes is the result of further processing, consequently longer time, required in case of violated expectations. Expectations, however, do not alter internal parameters of the system. These results reveal that sensory processes are delayed when expectations are not met, and a simple parsimonious computational model can successfully explain this effect.

Size aftereffect is non-local.

It is well known that prolonged exposure to a certain size stimulus alters the perceived size of a subsequently presented stimulus at the same location. How the rest of the visual space is affected by this size adaptation, however, has not been systematically studied before. Here, to fill this gap in literature, we tested size adaptation at the adapter location as well as the rest of the visual space. We used peripherally presented solid discs (Experiment 1) and rings (Experiment 2) as adapter and target (test) stimuli. Observers adapted to a mid-sized stimulus and judged the size of the subsequently presented smaller or larger target stimuli. Results showed that the perceived sizes of target stimuli were repelled away from the adapter size, not only at the adapter location but also at other locations. These findings demonstrate that size adaptation causes widespread distortion of the visual space and alters perceived size. We discuss possible computational models that may underpin the perceptual effect.

Distinct patterns of surround modulation in V1 and hMT.

Modulation of a neuron's responses by the stimuli presented outside of its classical receptive field is ubiquitous in the visual system. This "surround modulation" mechanism is believed to be critical for efficient processing and leads to many well-known perceptual effects. The details of surround modulation, however, are still not fully understood. One of the open questions is related to the differences in surround modulation mechanisms in different cortical areas, and their interactions. Here we study patterns of surround modulation in primary visual cortex (V1) and middle temporal complex (hMT+) utilizing a well-studied effect in motion perception, where human observers' ability to discriminate the drift direction of a grating improves as its size gets bigger if the grating has a low contrast, and deteriorates if it has a high contrast. We first replicated the findings in the literature with a behavioral experiment using small and large (1.67 and 8.05 degrees of visual angle) drifting gratings with either low (2%) or high (99%) contrast presented at the periphery. Next, using functional MRI, we found that in V1 with increasing size cortical responses increased at both contrast levels. Whereas in hMT+ with increasing size cortical responses remained unchanged or decreased at high contrast, and increased at low contrast, reflecting the perceptual effect. We also show that the divisive normalization model successfully predicts these activity patterns, and establishes a link between the behavioral results and hMT+ â€‹activity. We conclude that surround modulation patterns in V1 and hMT+ â€‹are different, and that the size-contrast interaction in motion perception is likely to originate in hMT+.

Homozygous LAMC3 mutation links to structural and functional changes in visual attention networks.

The occipital lobe contains a substantial part of the neural machinery involved in visual perception. Mutations in the LAMC3 gene have recently been shown to cause complex bilateral occipital cortical gyration abnormalities. However, to what extent these structural changes impact visual behavior is not known. We recorded responses for two screening test batteries targeting visual function (Leuven - Perceptual Organization Screening Test, Cortical Vision Screening Test) and measured eye fixation performance in a visual attention experiment from a patient with homozygous LAMC3 gene mutation. Using voxel-based morphometry (VBM) we quantitatively assessed the extent of structural changes brought on by the genetic mutation by comparing mean cortical curvature, cortical thickness, and gray matter volume in 34 cortical areas between patient and an age-, sex-, and education-matched control group. Anatomical connectivity between these cortical areas was investigated by a structural covariance analysis. Visual screening-, and behavioral results revealed that the patient's impairments were predominantly in visuo-spatial attention. Consistent with this, VBM and structural connectivity results revealed significant structural changes in cortical regions subserving attentional functions. We conclude that the LAMC3 gene mutation affects cortical areas beyond the occipital lobe and primarily those visual functions that involve heavily distributed networks - such as visuo-spatial attention.

Integrated assessment of visual perception abnormalities in psychotic disorders and relationship with clinical characteristics.

BACKGROUND: The visual system is recognized as an important site of pathology and dysfunction in schizophrenia. In this study, we evaluated different visual perceptual functions in patients with psychotic disorders using a potentially clinically applicable task battery and assessed their relationship with symptom severity in patients, and with schizotypal features in healthy participants. METHODS: Five different areas of visual functioning were evaluated in patients with schizophrenia and schizoaffective disorder (n = 28) and healthy control subjects (n = 31) using a battery that included visuospatial working memory (VSWM), velocity discrimination (VD), contour integration, visual context processing, and backward masking tasks. RESULTS: The patient group demonstrated significantly lower performance in VD, contour integration, and VSWM tasks. Performance did not differ between the two groups on the visual context processing task and did not differ across levels of interstimulus intervals in the backward masking task. Performances on VSWM, VD, and contour integration tasks were correlated with negative symptom severity but not with other symptom dimensions in the patient group. VSWM and VD performances were also correlated with negative sychizotypal features in healthy controls. CONCLUSION: Taken together, these results demonstrate significant abnormalities in multiple visual processing tasks in patients with psychotic disorders, adding to the literature implicating visual abnormalities in these conditions. Furthermore, our results show that visual processing impairments are associated with the negative symptom dimension in patients as well as healthy individuals.

Abnormal subcortical activity in congenital mirror movement disorder with RAD51 mutation.

PURPOSE: Congenital mirror movement disorder (CMMD) is characterized by unintended, nonsuppressible, homologous mirroring activity contralateral to the movement on the intended side of the body. In healthy controls, unilateral movements are accompanied with predominantly contralateral cortical activity, whereas in CMMD, in line with the abnormal behavior, bilateral cortical activity is observed for unilateral motor tasks. However, task-related activities in subcortical structures, which are known to play critical roles in motor actions, have not been investigated in CMMD previously. METHODS: We investigated the functional activation patterns of the motor components in CMMD patients. By using linkage analysis and exome sequencing, common mutations were revealed in seven affected individuals from the same family. Next, using functional magnetic resonance imaging (fMRI) we investigated cortical and subcortical activity during manual motor actions in two right-handed affected brothers and sex, age, education, and socioeconomically matched healthy individuals. RESULTS: Genetic analyses revealed heterozygous RAD51 c.401C>T mutation which cosegregated with the phenotype in two affected members of the family. Consistent with previous literature, our fMRI results on these two affected individuals showed that mirror movements were closely related to abnormal cortical activity in M1 and SMA during unimanual movements. Furthermore, we have found previously unknown abnormal task-related activity in subcortical structures. Specifically, we have found increased and bilateral activity during unimanual movements in thalamus, striatum, and globus pallidus in CMMD patients. CONCLUSION: These findings reveal further neural correlates of CMMD, and may guide our understanding of the critical roles of subcortical structures for unimanual movements in healthy individuals.

Context-dependent lightness affects perceived contrast.

Perceived contrast of a grating varies with its background (or mean) luminance: of the two gratings with the same photometric contrast the one on higher luminance background appears to have higher contrast. Does perceived contrast also vary with context-dependent background lightness even when the luminance remains constant? We investigated this question using a stimulus in which two equiluminant patches ("context squares", CSs) appear different in lightness. First we measured the lightness effect in a behavioral experiment. After ensuring that it was present for all participants, we conducted perceived contrast experiments, where participants judged the contrast of rectified incremental and decremental square-wave gratings superimposed on the CSs. For the incremental gratings participants' settings were significantly different for the two CSs. Specifically, perceived contrast was higher when the gratings were placed on the context square that was perceived lighter. In a follow-up experiment we measured perceived contrast of rectified gratings on isolated patches that differed in luminance. The pattern of results of the two experiments was consistent, demonstrating that possibly shared mechanisms underpin the effects of background luminance and context-dependent lightness on perceived contrast.

Contrast Affects fMRI Activity in Middle Temporal Cortex Related to Center-Surround Interaction in Motion Perception.

As the size of a high contrast drifting Gabor patch increases, perceiving its direction of motion becomes harder. However, the same behavioral effect is not observed for a low contrast Gabor patch. Neuronal mechanisms underlying this size-contrast interaction are not well understood. Here using psychophysical methods and functional magnetic resonance imaging (fMRI), we investigated the neural correlates of this behavioral effect. In the behavioral experiments, motion direction discrimination thresholds were assessed for drifting Gabor patches with different sizes and contrasts. Thresholds increased significantly as the size of the stimulus increased for high contrast (65%) but did not change for low contrast (2%) stimuli. In the fMRI experiment, cortical activity was recorded while observers viewed drifting Gabor patches with different contrasts and sizes. We found that the activity in middle temporal (MT) area increased with size at low contrast, but did not change at high contrast. Taken together, our results show that MT activity reflects the size-contrast interaction in motion perception.

Effect of contiguity and figure-ground organization on the area rule of lightness.

In a simple two-dimensional (2D) display composed of two uniform surfaces with different luminances, the lightness of the darker surface varies as a function of its relative area while its luminance is held constant (Gilchrist & Radonjic, 2009; Li & Gilchrist, 1999). This phenomenon is known as the area rule of lightness, and although it is extensively studied in the literature, the underlying principles are still largely unknown. Here, using computer-generated stimuli, we investigated the effects of contiguity and figure-ground organization on the area rule of lightness. Stimuli were 2D disks composed of radial sectors with high (25 cd/m2) or low (8 cd/m2) luminance. On each trial, observers judged the lightness of the sectors by adjusting the luminance of a matching patch. Four conditions were tested. In the contiguous condition, there were one dark and one light sector; in the noncontiguous condition, both the light and dark surfaces were split into four equal radial sectors. Figure and ground conditions were generated by adding small contextual elements to the stimulus. We found that the area rule applied under all conditions; however, the functional form of the effect showed marked differences across conditions. Taken together, our results show that both high-level (e.g., perceptual grouping, figure-ground organization) and low-level (e.g., spatial-summation) mechanisms play a role in the area rule of lightness.

Attention modulates neuronal correlates of interhemispheric integration and global motion perception.

In early retinotopic areas of the human visual system, information from the left and right visual hemifields (VHFs) is processed contralaterally in two hemispheres. Despite this segregation, we have the perceptual experience of a unified, coherent, and uninterrupted single visual field. How exactly the visual system integrates information from the two VHFs and achieves this perceptual experience still remains largely unknown. In this study using fMRI, we explored candidate areas that are involved in interhemispheric integration and the perceptual experience of a unified, global motion across VHFs. Stimuli were two-dimensional, computer-generated objects with parts in both VHFs. The retinal image in the left VHF always remained stationary, but in the experimental condition, it appeared to have local motion because of the perceived global motion of the object. This perceptual effect could be weakened by directing the attention away from the global motion through a demanding fixation task. Results show that lateral occipital areas, including the medial temporal complex, play an important role in the process of perceptual experience of a unified global motion across VHFs. In early areas, including the lateral geniculate nucleus and V1, we observed correlates of this perceptual experience only when attention is not directed away from the object. These findings reveal effects of attention on interhemispheric integration in motion perception and imply that both the bilateral activity of higher-tier visual areas and feedback mechanisms leading to bilateral activity of early areas play roles in the perceptual experience of a unified visual field.

Homozygosity mapping and targeted genomic sequencing reveal the gene responsible for cerebellar hypoplasia and quadrupedal locomotion in a consanguineous kindred.

The biological basis for the development of the cerebro-cerebellar structures required for posture and gait in humans is poorly understood. We investigated a large consanguineous family from Turkey exhibiting an extremely rare phenotype associated with quadrupedal locomotion, mental retardation, and cerebro-cerebellar hypoplasia, linked to a 7.1-Mb region of homozygosity on chromosome 17p13.1-13.3. Diffusion weighted imaging and fiber tractography of the patients' brains revealed morphological abnormalities in the cerebellum and corpus callosum, in particular atrophy of superior, middle, and inferior peduncles of the cerebellum. Structural magnetic resonance imaging showed additional morphometric abnormalities in several cortical areas, including the corpus callosum, precentral gyrus, and Brodmann areas BA6, BA44, and BA45. Targeted sequencing of the entire homozygous region in three affected individuals and two obligate carriers uncovered a private missense mutation, WDR81 p.P856L, which cosegregated with the condition in the extended family. The mutation lies in a highly conserved region of WDR81, flanked by an N-terminal BEACH domain and C-terminal WD40 beta-propeller domains. WDR81 is predicted to be a transmembrane protein. It is highly expressed in the cerebellum and corpus callosum, in particular in the Purkinje cell layer of the cerebellum. WDR81 represents the third gene, after VLDLR and CA8, implicated in quadrupedal locomotion in humans.

Recessive LAMC3 mutations cause malformations of occipital cortical development.

The biological basis for regional and inter-species differences in cerebral cortical morphology is poorly understood. We focused on consanguineous Turkish families with a single affected member with complex bilateral occipital cortical gyration abnormalities. By using whole-exome sequencing, we initially identified a homozygous 2-bp deletion in LAMC3, the laminin γ3 gene, leading to an immediate premature termination codon. In two other affected individuals with nearly identical phenotypes, we identified a homozygous nonsense mutation and a compound heterozygous mutation. In human but not mouse fetal brain, LAMC3 is enriched in postmitotic cortical plate neurons, localizing primarily to the somatodendritic compartment. LAMC3 expression peaks between late gestation and late infancy, paralleling the expression of molecules that are important in dendritogenesis and synapse formation. The discovery of the molecular basis of this unusual occipital malformation furthers our understanding of the complex biology underlying the formation of cortical gyrations.

Perceived glossiness in high dynamic range scenes.

We investigated how spatial pattern, background, and dynamic range affect perceived gloss in brightly lit real scenes. Observers viewed spherical objects against uniform backgrounds. There were three possible objects. Two were black matte spheres with circular matte white dots painted on them (matte-dot spheres). The third sphere was painted glossy black (glossy black sphere). Backgrounds were either black or white matte, and observers saw each of the objects in turn on each background. Scenes were illuminated by an intense collimated source. On each trial, observers matched the apparent albedo of the sphere to an albedo reference scale and its apparent gloss to a gloss reference scale. We found that matte-dot spheres and the black glossy sphere were perceived as glossy on both backgrounds. All spheres were judged to be significantly glossier when in front of the black background. In contrast with previous research using conventional computer displays, we find that background markedly affects perceived gloss. This finding is surprising because darker surfaces are normally perceived as glossier (F. Pellacini, J. A. Ferwerda, & D. P. Greenberg, 2000). We conjecture that there are cues to surface material signaling glossiness present in high dynamic range scenes that are absent or weak in scenes presented using conventional computer displays.

Perceptual grouping-dependent lightness processing in human early visual cortex.

Lightness, the perceived relative achromatic reflectance of a surface, depends strongly on the context within which the surface is viewed. Modest changes in the two-dimensional configuration or three-dimensional scene geometry may lead to profound variations in lightness even though the surface luminance remains constant. Despite recent progress, we are far from a complete understanding of how various aspects of spatial context affect lightness processing in the cortex. Here we use a novel stimulus to show that perceptual grouping through occluders can affect lightness. We first report behavioral results showing how lightness across occlusion depends on spatially distant image features, including luminance and contrast. Next using functional magnetic resonance imaging (fMRI) we show that human early visual cortex responds strongly to occlusion-dependent lightness variations with little or no attention. These results suggest that elements of three-dimensional scene interpretation play a role in early cortical processing of lightness.

Estimating the glossiness transfer function induced by illumination change and testing its transitivity.

The light reflected from a glossy surface depends on the reflectance properties of that surface as well as the flow of light in the scene, the light field. We asked four observers to compare the glossiness of pairs of surfaces under two different real-word light fields, and used this data to estimate a transfer function that captures how perceived glossiness is remapped in changing from one real-world light field to a second. We wished to determine the form of the transfer function and to test whether for any set of three light fields the transfer function from light field 1 to light field 2 and the transfer function from light field 2 to light field 3 could be used to predict the glossiness transfer function from light field 1 to light field 3. Observers' estimated glossiness transfer functions for three sets of light fields were best described by a linear model. The estimated transfer functions exhibited the expected transitivity pattern for three out of four observers. The failure of transitivity for one observer, while significant, was less than 12.5% of the gloss range.